Papers with combined model
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding (2022.acl-long)
Copied to clipboard
Yanan Zheng, Jing Zhou, Yujie Qian, Ming Ding, Chonghua Liao, Li Jian, Ruslan Salakhutdinov, Jie Tang, Sebastian Ruder, Zhilin Yang
| Challenge: | Existing evaluation protocols for few-shot natural language understanding (NLU) tasks are inconsistent and hinder fair comparison and measuring progress. |
| Approach: | They propose an evaluation framework that improves previous evaluation procedures in three key aspects, i.e., test performance, dev-test correlation, and stability. |
| Outcome: | The proposed framework improves evaluation procedures in three key aspects, i.e., performance, dev-test correlation, and stability. |
Multimodal Emoji Prediction (N18-2)
Copied to clipboard
| Challenge: | Emojis are small images that are commonly included in social media text messages. |
| Approach: | They propose a multimodal approach that is able to predict emojis in Instagram posts by using both text and image. |
| Outcome: | The proposed model incorporates both text and image to improve accuracy . |
Plug-in and Fine-tuning: Bridging the Gap between Small Language Models and Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) are renowned for their extensive linguistic knowledge and strong generalization capabilities, but their high computational demands make them unsuitable for resource-constrained environments. |
| Approach: | They propose a framework that integrates a single frozen layer from an LLM into a SLM and fine-tunes the combined model for specific tasks. |
| Outcome: | The proposed framework improves performance across a range of natural language processing tasks, including both natural language understanding and generation. |
Bridging the Gap: Attending to Discontinuity in Identification of Multiword Expressions (N19-1)
Copied to clipboard
| Challenge: | Existing approaches to identify discontinuous multiword expressions are limited in dealing with discontinuous occurrences. |
| Approach: | They propose a method to tag Multiword Expressions using a language-independent deep learning architecture to target discontinuity. |
| Outcome: | The proposed model outperforms baseline models on a multilingual dataset and scores higher than baseline models. |
Comparing Approaches to Language Understanding for Human-Robot Dialogue: An Error Taxonomy and Analysis (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing approaches to language understanding for human-robot interaction are limited by domain-specific grammars and domain-level inputs. |
| Approach: | They compare a relevance-based classifier with a GPT-2 model and compare their results . they find that the relevance- and GPT-based models make different errors . |
| Outcome: | The proposed model outperforms the existing model with 2000 examples as training data. |